Equation of motion for process matrix: Hamiltonian identification and dynamical control of open 

quantum systems 
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We develop a general approach for monitoring and controlling evolution of open quantum systems. In contrast 
to the master equations describing time evolution of density operators, here, we formulate a dynamical equation 
for the evolution of the process matrix acting on a system. This equation is applicable to non-Markovian and/or 
strong coupling regimes. We propose two distinct applications for this dynamical equation. We first demonstrate 
identification of quantum Hamiltonians generating dynamics of closed or open systems via performing process 
tomography. In particular, we argue how one can efficiently estimate certain classes of sparse Hamiltonians by 
performing partial tomography schemes. In addition, we introduce a novel optimal control theoretic setting for 
manipulating quantum dynamics of Hamiltonian systems, specifically for the task of decoherence suppression. 

PACS numbers: 03.65.Wj, 03.67.-a, 02.30. Yy 



Introduction. — Characterization and control of quantum 
systems are among the most fundamental primitives in quan- 
tum physics and chemistry U 1^. In particular, it is of 
paramount importance to identify and manipulate Hamilto- 
nian systems which have unknown interactions with their em- 
bedding environment P]- In the past decade, several meth- 
ods have been developed for estimation of quantum dynami- 
cal processes within the context of quantum computation and 
quantum control 01 SHIS HUD- These techniques are known 
as "quantum process tomography" (QPT), and originally were 
developed to estimate the parameters of a "superoperator" or 
"process matrix", which contains all information about the 
dynamics. This is usually achieved through an inversion of 
experimental data obtained from a complete set of state tomo- 
graphies. QPT schemes are generally inefficient, since for a 
complete process estimation the number of required experi- 
mental configurations and the amount of classical information 
processing grows exponentially with size of the system. Re- 
cently, alternative schemes for partial and efficient estimation 
of quantum maps have been developed IH |^ 0, Hi |9t [lOt] in- 
cluding efficient data processing for selective diagonal |7(] and 
off-diagonal parameters of a process matrix [8]. However, it 
is not clear how the estimated elements of the process matrix 
could help us actually characterize the set of parameters for 
Hamiltonians generating such dynamics. These parameters of 
interest generally include the system free Hamiltonians and 
those coupling strengths of system-bath Hamiltonians. More 
importantly, it is not fully understood how the relevant in- 
formation obtained from quantum process estimation exper- 
iments can be utilized for other applications such as optimal 
control of a quantum device. 

In this work, we develop a novel theoretical framework for 
studying general dynamics of open quantum systems. In con- 
trast to the usual approach of utilizing master equations for 
density operator of a quantum system, we introduce an equa- 
tion of motion for the evolution of a process matrix acting on 
states of a system. This equation does not presume Markovian 
or perturbative assumptions, hence provides a broad approach 
for analysis of quantum processes. We argue that the applica- 



tion of partial quantum estimation schemes fs*, '6', 1^ |^ [Toll 
enables efficient estimation of sparse Hamiltonians. Further- 
more, the dynamical equation for process matrices leads to 
alternative ways for controlling generic quantum Hamiltonian 
systems. In other words, one can utilize this equation to drive 
the dynamics of a(n) closed (open) quantum system to any de- 
sired target quantum operation. In particular, we apply quan- 
tum control theory to find the optimal fields to decouple a sys- 
tem from its environment, hence, "controlling decoherence". 

Dynamical equation for open quantum systems. — In quan- 
tum theory, the evolution of a system — assuming separa- 
ble initial state of the system and environment — can be de- 
scribed by a (completely -positive) quantum map Etio) — 
^ ■ Ai {t)QA\ (i), where g is the initial state of the system ifTlll . 
An alternative, more useful expression is obtained by expand- 
ing Ai{t) = Y.m^^ra{t)Om m {ak'-k = 0, 1 , . . . , - 1} (a 
fixed operator basis for the d-dimensional Hilbert space of the 



system) which leads to Etio) = Emnio XmnlOc^mPcrt . The 
positive-Hermitian process matrix = \Ylnaim{'t)ain{t)\ 
represents 8t in the {cFk] basis, where bar denotes complex 
conjugation. The process matrix elements Xmn{t): in any 
specific time t, can be experimentally measured by any QPT 
scheme [llS]. 

In an open quantum system, the time-dependent Hamil- 
tonian of the total system-bath {SB) has the general form 
H{t) = Hs{t) + Heit) + Hssit), where S (B) stands 
for the system (bath or the surrounding environment). We 
denote the evolution operator which is generated from this 
Hamiltonian, from time to t, by U{t). The Hamiltonian 
HsB{t) can be written as i/5B (t) — J^k ^k{t)(Tk®Bk, where 
Afe(i)s are the coupling strengths of the system-bath interac- 
tion, and {Bk} are some bath operators. Now we describe the 
dynamics in the interaction picture by introducing the time 
evolution operators Uo{t), Us{t), and UB{t), generated by 
Hq = Hs ® Ib ^ Is ® Hb, Hs, and Hb, respectively. 

The system-bath Hamiltonian in the interaction picture 
becomes: Hj{t) = Ul{t)HsB{t)Uo{t). By introducing 
^k{t) = ul{t)akUs(t) = Y.iSki{t)(Ji and Bk{t) = 
Ug{t)BkUB{t) as the rotating operators under the evolution 
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of the free Hamihonian of the system and bath, we can rewrite 
— 12k ^k{t)^k{t) <E) Bk{t). The Schrodinger equation 
in the interaction picture can be expressed as; 

*dAf(i)/dt = ^ij;,(iM^(t), (1) 

k 

Where f//(i) = Ul{t)Uit), (t) = B{h^Ui{t)\bo) b = 
X^m ^im(.^)'^m are the Kraus operators at the interaction pic- 
ture, H^j{t) = Y^pqK^pq B{bi\Bp\bj)Bcrq, and {\bi)} is a 
basis for the bath Hilbert space. The interaction picture x 
matrix is defined as xLnit) = «L(Oa™(0' which is re- 
lated to the elements of the measured process matrix through 

Thus, the time evolution of the coefficients reads as: 

idai„Jdt = J2kipq o-iiKspqa'i'P^ B{bt\Bp\bk) b, (2) 

where Q!'"''„j — Tr[(Tfccr;crJ,J. From this equation, one can ob- 
tain the time evolution of x' as follows: 

idx'/dt = HK - K''H\ (3) 

where 

[-fflnl^mj) = Y.pq^Spqa'^^n B{bJ\B,n\b^)B, (4) 

[■^]{imj)n ^im^jm (^) 

in which (imj) is considered as a new single index. The order 
of the pseudo-Hamiltonian H is cP x (fi, but number of inde- 
pendent parameters is ^ (P, which is the maximum number 
of nonzero ApS. By using a generalized commutator notation 
[A,B]* = AB - B'^A^, Eq. OJ can be represented in the 
following form: 

idx'/dt^[H,K]\ (6) 

This is the (super-) dynamical equation for open quantum sys- 
tems, i.e., an equation for the time variation of quantum dy- 
namics itself, in which no state of the system appears, in con- 
trast to the existing master equations 1, 1 1.1 . 

The knowledge of the K matrix is generally required for 
application of Eq. (|6]l. The x^ matrix can be diagonalized 
by the unitary operator V: x^ — VDV\ where D = 
diag(Di). Then, the Kraus operators in the interaction pic- 
ture are Aj{t) — \fDi^^^^VmiCfm f^- Hence, we obtain 
«im = VAKni and Kim jn = \fD~lTjVmiV nj ■ Diagonal- 
ization of a sparse x^ matrix, hence construction of the K 
matrix, can be performed efficiently. The unknown parame- 
ters of Eq. (|6]) are elements of H matrix which contain the 
information about the system-bath coupling strengths A^. 

For unitary evolutions, following a similar approach, the 
dynamical equation for the process matrix is obtained as: 

idx/dt^[H,x]\ (7) 

where H = \hmi], Knn{t) = Y^k^'^'in^kit), and hi{t) are 
defined through H{t) — hi{t)ai. It should be noted that 



Hermiticity of H implies only (P real independent parameters 
in H, which can be estimated via QPT schemes. 

Hamiltonian identification. — Consider a large ensemble of 
the identically prepared systems in the state g, half of which 
are measured after duration t, and the rest are measured at 
t + At, where At is small relative to t. Thus, by perform- 
ing any type of QPT strategy one can obtain the matrix el- 
ements Xmn{t) and Xrnn{t + At), hcncc their derivatives 
Xnin{t) ~ {Xrnn{t + At) - Xrnn{t)) / At with accuracy At. 
Consequently, using Eq. O (Eq. (|6]l) one can in principle 
identify the free [system-bath] Hamiltonians for closed (open) 
quantum systems. 

For unitary evolutions, a simple relation between the ele- 
ments of the X rnatrix and the system Hamiltonian param- 
eters is obtained, up to the second order in t and a global 
phase Tr[H], as: xoo(^) ~ 1 - J2ij a^ahih^ + a\^hihj, 
Xmoit) ~ ihmt - ^t^ Y.2j a'^^mhihj, and 

Xran{t) W hmh„t'^ , (8) 

where m,n ^ 0. From Eq. ([8]), for a given short time t, 
we have hn — e^'^'^ sJXnnjt, from which the relative errors 
satisfy Re[(5/in//iJ = Sxnnl^Xnn- According to the Cher- 
noff bound [i2|j to estimate x„„s with accuracy A ^ 
\Xnn - X„„| = ^Xnn — wherc x„„ is the average of the 
results of M repeated measurements — with success proba- 
bihty greater than 1 — e, one needs M — 0{\ loge/2|/A^). 
Information of the phases (^„, up to a global phase, can be 
estimated by measuring XtnnS for m ^ n. 

Using the above construction, next we discuss efficient 
Hamiltonian identification schemes via performing certain 
short-time scale QPTs. A precursor to this type of short-time 
expansion in order to efficiently obtain process matrix param- 
eters can be found in Ref. 1 13], however, its underlying mod- 
els, the assumptions, and the identification method are more 
restrictive and generally incommensurable with ours. 

In generic iV-body physical systems (e.g., iV qubits), in- 
teractions are L-local where L is typically 2. That is, B = 
i/fc, where each iJ^ includes only interactions of L sub- 
systems, with overall 0{N^) independent parameters. This 
implies that in the {cr^} basis H has a sparse-matrix repre- 
sentation. Hence, the number of free parameters of the cor- 
responding unitary or process matrix, unlike their exponen- 
tial size, will be polylog(c?) (i.e., a polynomial of N). Here, 
we mainly concentrate on controllable L-local Hamiltonians, 
which are of particular interest in the context of quantum in- 
formation processing in order to generate a desired quantum 
operation. An important example of this class is the Heisen- 
berg exchange Hamiltonian in a network of spins with nearest 
neighbor interactions. This 2-local sparse Hamiltonian (in the 
Pauli basis) also generates a sparse process matrix ifioll and 
is computationally universal over a subspace of fixed angular 
momentum 1 14]. 

Let us consider a sparse Hamiltonian, H{t) = 
J2m^m{t)o'm, with polylog((i) nonzero hm.s, where {am} 
is the nice error basis [6]. In the short-time limit, accord- 
ing to Eq. ([8]l, if the Hamiltonian is sparse in the {cik} ba- 
sis, only polylog((i) of hm& would be nonzero. Thus, num- 
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ber of nonzero elements in the \t'^hmhn\ /„ block would 
be also of the same order. A priori knowledge of the gen- 
eral form of a given sparse Hamiltonian leads to [up to 0{t^)] 
nonzero elements in the [t^/im^n] „j „_^q block, according to 
Eq. (O. Therefore, if we can efficiently determine all nonzero 
elements of this block, we would have polylog((i) quadratic 
equations from which we can estimate hmS- In other words, 
by only polynomial experimental settings we would be able 
to extract relevant information about the Hamiltonian from a 
suitable QPT experiment [15]. In general, there are three dis- 
tinct process estimation techniques, including Standard Quan- 
tum Process Tomography (SQPT) [IJ], Direct Characterization 
of Quantum Dynamics (DCQD) [5], and Selective Efficient 
Quantum Process Tomography (SEQPT) [8]. The scaleup 
of physical resources varies among these process estimation 
strategies [9]. SQPT is inefficient by construction, since we 
still need to measure an exponentially large number of observ- 
ables in order to reconstruct the process matrix through a set 
of state tomographies. SEQPT can efficiently estimate quan- 
tum sparse Hamiltonians via selectively estimating a polyno- 
mial number of Xmn& associated to the Hamiltonian, within 
the context of short-time analysis. Using the DCQD scheme, 
in short-time limit, one can also efficiently estimate all the 
parameters of certain sparse Hamiltonians, specifically all the 
diagonal elements Xnn — a detailed analysis thereof is be- 
yond the discussion of this work and will be presented in an- 
other publication [16]. Note that in contrast to SQPT, both 
DCQD and SEQPT assume access to noise-free ancilla chan- 
nels. However, recently a generalization of the DCQD scheme 
to certain cases of calibrated faulty preparation, measurement, 
and auxiliary systems has been developed iflTll . 

We emphasize that, within the context of short-time anal- 
ysis, the efficient estimation is only applicable to the Hamil- 
tonians for which the location of nonzero elements in a given 
basis is known from general physical or engineering consid- 
erations, such as in the exchange Hamiltonian in solid-state 
quantum information processing ifTill . The exchange Hamil- 
tonian describes the underlying interactions for various sys- 
tems, such as spin-coupled quantum dots [18], donor-atom 
nuclear/electron spins il9ll . semiconductor quantum dots i20ll . 
and superconducting flux qubits ||2l|]. The anisotropic ex- 
change Hamiltonian exists in quantum Hall systems ll22ll . 
quantum dots/atoms in cavities [23], exciton-coupled quan- 
tum dots [24], electrons in liquid-Helium [25], and neutral 
atoms in optical lattices [26]. 

Applications to quantum dynamical control. — One imme- 
diate application of any equation of motion — i.e, dynamical 
equation — for a quantum or classical system is to manipulate 
its state or dynamics toward a desired target. The ability to 
control quantum dynamics by certain external control fields is 
essential in many applications including physical realizations 
of quantum information devices. Due to environmental noise 
and device imperfections, it is generally difficult to maintain 
quantum coherence during dynamical evolution of quantum 
systems. Reducing or controlling decoherence, therefore, is 
an important objective in a control theoretic investigation of 
quantum systems. 

Optimal control theory (OCT) [27], has been developed 



for finding control fields to guide a quantum system, sub- 
ject to natural or engineering constraints, as close as possible 
to a particular target. For closed quantum system, OCT has 
been proposed for controlling states fxf] and unitary dynam- 
ics [28]. In OCT, a quantum system is driven from an initial 
state or unitary operation to a final configuration, via applying 
external fields. This is achieved, for example, by modifying a 
free Hamiltonian Hq as H{t) ~ Hq — fnT{t), where fiisa sys- 
tem operator (e.g., atomic or molecular dipole moment) and 
7r(t) is a shaped external field (e.g., laser pulse) |i28J. The op- 
timization is based on maximizing a yield functional 3^, e.g., 
fidelity of the final and target configurations, by a variational 
procedure (6y/6TT ~ 0) subject to a set of constraints. 

Having an equation of motion implies how one can control 
dynamics of a system toward a target configuration. Thus, a 
new method for controlling dynamics of open quantum sys- 
tems can be developed by our equation of motion (Eq. 
specifically applicable to optimal decoherence control. For 
isolated systems we have = (hence H — 0), from which 
one can obtain xinn = 5,noSno = [-Eoo]m«- However, due 
to decoherence or other environmental effects, there might be 
some residual interaction Hq between the system and envi- 
ronment. Our objective, here, is to apply a control field Tr{t) 
to modify the pseudo-Hamiltonian, Eq. in order to sup- 
press the decohering interaction. Since H is linear in As, ap- 
plying a control coupling field would affect H linearly. Thus, 
if we introduce an external controllable field 7r{t), the pseudo- 
Hamiltonian Hq becomes H{t) — Hq — fnT{t), where /x is 
a system operator. The control strategy is to find the optimal 
7r(i) such that the constrained fidelity 

3^ = Re [3^ - dt Tr{(dxVdi + ^[H{t), K{t)r)A{t)}] 



rjj;^dt\7:{t)\yf{t), 



(9) 



becomes maximal, where y = Re [Tr[x^^(T)£^oo]] and A{t) 
(rj) is an operator (scalar) Lagrange multiplier. The last term 
in Eq. (|9]l describes an "energy" constraint ll28ll . in which f{t) 
is a shape function for switching the control field on and off. 
In order to find the optimal field, we vary tt. A, and a^,„, and 
set Sy = 0. By variation of the operator Lagrange multiplier 
A, we obtain the original dynamical equation [Eq. (|6]l], and 
variation of tt yields 



nit) 



m 

2rj 



Im[Tr([/x,ii:(t)]*A(<))] 



(10) 



This equation implies that the knowledge of K{t) and A{t) 
is necessary to specify the optimal control field. The super- 
operator K{t) can be constructed by process estimation tech- 
niques. To obtain the dynamics of A{t) we vary af^, which 
in turn leads to variations of and K. Thus, the Lagrange 
operator satisfies 
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(11) 
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Equations ( fTOl i and ( fTTT i. in principle, can be solved iteratively 
by the Krotov method 11281 129I1 to find the optimal control 
field TT for decoherence suppression. That is, one can effec- 
tively preserve coherence in dynamics of an open quantum 
system by applying external pulses to decouple it from the en- 
vironment. This could provide an alternative method for an 
effective dynamical decoupling (3d] in the language of pro- 
cess matrix evolution. One can devise a learning decoherence 
control strategy by estimating K{t), via certain QPT schemes 
on subensembles of identical systems, after each application 
of the optimal control field in a given time t. The information 
learned from the estimation is used through Eqs. (Igt-lfTTTi for 
a second round to find a new optimal tt. This procedure can 
be repeated to enhance the decoherence suppression task. 

Conclusion and outlook. — We have developed an alterna- 
tive framework for monitoring and controlling dynamics of 
open quantum systems, and have derived a dynamical equa- 
tion for the time variation of process matrices. This nonper- 
turbative approach can be applied to non-Markovian systems 
and systems or devices strongly interacting with their embed- 
ding environment. In addition, we have shown how the infor- 
mation gathered via partial process tomography schemes can 
be used to efficiently identify unknown parameters of certain 
classes of local Hamiltonians in short-time scales. Further- 



more, we have proposed an optimal quantum control approach 
for the dynamics of open quantum systems. Specifically, we 
have suggested how this mechanism can be used for a generic 
decoherence suppression. 

The approach presented here can be used for exploring new 
ways for dynamical open-loop/learning control of Hamilto- 
nian systems llsill . One can utilize continuous weak mea- 
surements [3^ for process tomography to develop a real-time 
dynamical closed-loop control for a quantum system. Our 
Hamiltonian identification scheme could be utilized for ef- 
ficient verification of certain correlated errors for quantum 
computers and quantum communication networks Us- 
ing our dynamical approach, one could explore the existence 
of certain symmetries in system-bath couplings which would 
lead to noiseless subspaces and subsystems. The dynamical 
equation developed here can also be applied to studying the 
energy transfer in multichoromophoric complexes in the non- 
Markovian and/or strong interaction regimes (3^. 
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